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<§) Edge enhanced error diffusion algorithm. 

@ A method of dynamically adjusting the threshold level of an error diffusion algorithm to selectively 
control the amount of edge enhancement introduced into the encoded output (Bn). The threshold level is 
selectively modified (40, 42) on a. pixel by pixel basis and may be used to increase or decrease the edge 
enhancement of the output digital image, thus, more closely representing the original detail and edge sharpness 
of the continuous tone input image (In). 
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EDGE ENHANCED ERROR DIFFUSrON ALGORITHM 

The present Invention relates to the representation of digital image data, and in particular, to the binary 
or inultf level representation of Innages for display purposes. 

The representation of continuous tone pictorial data In a binary format is a major concern as the need 
increases to transmit and display images. The binary representation of image information Is desired in order 

5 to reduce the sensitivity to noise in transmission and storage or to enable the accurate depiction of 
continuous tone originals with binary media. In the general field of digftal halftoning, -there have been 
disclosed different methods to convert continuous tone to binary images in such a manner as to preserve 
. the appearance of tonal gradation similar to the original image. For example. US-A-4,625,222 to Bassetti et 
aL discloses a print enhancement control system for an electrostatic copying machine wherein -control logic 

10 circuitry processes a set of image altering parameters to improve image production.. quality. These 
parameters, whose values are either predetermined, fixed or have been received from an exterior source, 
improve image quality (i.e., resolution) by modifying modulated gray signals. 

US-A-4.700,229 to Herrmann et a!, discloses an image enhancement circuit which converts a low quality 
image signal into a high quality image signal by modifying the binary representation of a picture. Image 

15 enhancement is accomplished by multiplying a series of error difference signals by a series of weighting 
factors k(i) which produce a clearer image by improving picture resolution. 

lJS-A-4.672,463 to Tomohlsa et aL discloses a method to improve image quality within an electrostatic 
reproduction machine wherein the sharpness of an image is improved based on the value of an image 
sharpness control parameter that has been calculated examining the copy quality of an original. 

so US-A-4,709,250 to Takeuchi discloses an Image forming apparatus which improves the halftone image 
quality of an originaL The pulse width of a reference control signal controls and improves image quality in 
response to a detected image density signal. 

US-A'4.724,461 to Rushing discloses an Image Improving process control for an electrostatic copying 
machine which maintains high image quality by adjusting a set of process control parameters. 

25 US-A-4,256,401 to Fujimura et ai. discloses an image density adjustment method wherein a predeter- 
mined image density level within an electrostatic copying machine is maintained at a standard density by 
varying a set of input control parameters. 

US-A-4,693.593 to Gerger discloses a method of Improving the Image quality by controlling a single 
process parameter in response to changes in sensitometric characteristics of an image transfer member. 

30 These systems, although providing some degree of image improvement, generally do not provide the 
means to contirol V^e edge enhancement of regions within the Image. 

Other prior work, such as shown in the Proceedings of the Society for Information Display, Volume 17, 
1976, includes a numerical screening algorithm, the Floyd and Steinberg error diffusion algorithm, as a 
coding technique for the binary encoding of grsyscale image data. Modifications to the Floyd - Steinberg 

35 algorithm may, as shown by Blllotet-Hoffman and Bryngdahl in the Proceedings of the Society for 
Information Display, Volume 24, 19B3, include a varying threshold, a dither, Instead of a fixed threshold. 
This visually decodable technique is presently utilized, for example, in computer displays v/here the 
resolution of the output device is limited. The adaptive nature of the Floyd - Steinberg algorithm 
automatically provides a sharp, edge-enhanced appearance which, while visually appealing, may not 

40 necessarily be desirable in the output image. 

A difficulty with the Floyd-Steinberg error diffusion algorithm is that an inherent edge enhancement is 
built into the algorithm. Analysis of the output of the Floyd - Steinberg error diffusion algorithm illustrates a 
characteristic overshoot (too dark or too light) at upward and downward transitions, or steps, in the 
continuous tone dfgital image data. As used within this specification, continuous tone refers to input data 

46 that has been quantized to a larger number of discrete values than Intended for the output data. 

It is an object of the present invention, therefore, to be able to adjust the edges of a given digital image 
in a manner to improve the overall appearance of the image. \l is another object of the present invention to 
selectively increase or decrease the amount of edge enhancement in a given digital image using a modified 
error diffusion algorithm for the encoding of the continuous tone input data. 

50 According to one aspect of the present invention, there is provided a method of image encoding in a 
system for manipulating and displaying digital images represented by a plurality of pixels, each pixel having 
a given value, the system having a memory for digitally storing the Image pixels and a screen for displaying 
the image as a raster of pixels having a plurality of output states, the method including the steps of; 
comparing the given value of a first pixel with a threshold. 

determining the output state of said first pixel depending upon the relationship of the pixel to the output 
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state. 

introducing the variance of the first pixel value from the output state Into the deviation of a second pixel 

value from the threshold to determine the output state of the second pixeK 

repeating the steps for each pixel of the digital image, and 
5 selectively changing the threshold level during the image encoding, including analyzing the value of each 

pixel in order to determine if the threshold level should be changed. 

According to another aspect of the invention, there is provided a method of edge enhancement of a 

digital image in a system for manipulating digital images, represented by a plurality of pixels having 

greyscale levels, to provide a first and a second pixel state, the method including the steps of: 
10 comparing the greyscale level of a first pixel to a threshold level To to determine a first or second state for 

said first pixel. 

analyzing the greyscale level of a second pixel, 

responding to the analysis of the greyscale level of the second pixel to change the threshold level to Ti . 
and 

15 comparing the greyscale level of the second pixel to the threshold level Ti to determine a first or second 

state for said second pIxeL 

ThuSp the present invention enables the dynamic adjustment of the threshold of an error diffusion 

algorithm to selectively control the amount of edge enhancement Introduced into the binary encoded output. 

The threshold level is selectively modified on a pixel by pixel basis and may be used to increase or 
20 decrease the edge enhancement of the output digital image, thus* more closely representing the original 

detail and edge sharpness of the continuous tone input Image, or to Improve the perceived quality of the 

image which might be achieved by intentionally deviating from a faithful representation. 

Methods In accordance with the invention will now be described, by way of example, with reference to 

the accompanying drawings wherein the same reference numerals have been ^plied to lii<e parts and 
25 wherein: 

FIG. 1 Is a prior art block diagram illustrating the 1 -dimensional error diffusion technique; 

FIG. 2 is an illustration of the input and corresponding signal output for the prior art technique; 

FIG. 3 is a general flow chart of the edge enhancement system in accordance with the present invention; 

and 

30 FIG, 4 is an illustration of the input and conresponding signal output of the system in Figu-e 3 In 
accordance with the present invention. 
With respect to FIG, 1, there is shown a generalized block diagram illustrating the prior art Floyd - 
Steinberg error diffusion algorithm for displaying continuous tone digital Images. The algorithm has been 
simplified to a 1 -dimensional representation for clarity, however, it should be recognized that the algorithm 
35 is extensible to multidimensional systems. The algorithm may be expressed as, 

111 

f4<n) - stcpl ltn» Ili»^ ti(i) } Tol, (1) 



where the output signal B(n) is a function of the input signal l(n) and a threshold To 

The error diffusion algorithm is implemented using the constant threshold level To to encode the 

^5 continuous tone input image. The thresholding, or clipping, of the input pixel results in an output pixel level 
and an associated error value. The error value is allocated to subsequent pixels based upon an appropriate 
weighting scheme. Various weighting techniques may be used, for distribution of tfie error value, to modify 
the output image generated using the error diffusion algorithm. 

With respect to FIG. 1. the Image input block 10 introduces the input digital image into the system 

50 on a pixel by pixel basis, where n represents the input image pixel number. Each input pixel has its 
corresponding error value E„., added to the input value at adder biock 12. resulting in the modified 
image block 14. where E„.i is the error value of the previous pixel (n-1). The modified image data, the sum 
of the input value and the error value of the previous pixel + E^-i)* is passed to the threshold comparator 
20, The modified image data is compared to the constant threshold value To. from block 16. to determine 

55 appropriate output level Bn 22 or 24, Once the output level B^. is determined, it is subtracted from the 
modified image value to generate the error level for the subsequent input pixei. The subtraction 
operation is represented by the sign inversion block 26 and subsequent adder block 28. with E„ 
representing the difference between the modified image value (In + En.^) and the output value Bn for pixel 

3 
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n. as represented by error block 30. The delay buffer block 32 represents a single prxef delay to store in 
the simplified 1 -dimensionaf situatron. However, a multidimensional implementation would require a larger 
delay block 32 capable of summing and storing multiple weighted error values. 

The cyclical processing of pixels is continued until the end of the continuous tone input data is reached. 

5 RG. 2 illustrates the processing stages of a portion of a typicaf scanltne» with n representing the input 
image pixel number. In FIG. 2a. in denotes the value of the continuous tone digital input pixels. The 
modified image value, including the input and error, is represented by (In + E^^a.) with a constant threshold 
To superimposed as a dashed line in FIG. 2b. At any point in FIG. 2b that the modified image value (l^ + E„. 
i) exceeds the threshold level To, a binary pulse will be ou^t as indicated by curve in FIG. 2c. 

w Specifically, in FIG. 2b, (In + En.i) level 80 is below the To threshold level 88, resulting in B„ output level 90 
in FIG. 2c and an error equal to the difference between (!„ + Ep.i) and B^. Processing of the subsequent 
input image pixel (n + 1) provides a modified Image value 81 in FIG. 2b which is above the To threshold 
level 88. This results in an output level Bn + i indicated by 92 In FIG 2c. The error value to be associated 
with the following pixel will again be determined by the difference between {\^\^^ + E{n-T)+i) and Mr where 

15 Bn-Hi is now unity. The modified (mage value for input pixel (n + 2) is indicated by level 82 in RG, 2b. 
Continued processing of the input pixels in FIG* 2a would eventually result in a (ln+ En-i) modified image 
value 83 exceeding the To threshold level 88 and a resultant output level 96. Here, B^ is set to 1 
immediately before an In input edge transition 72 to 74. resulting in (ln+ E^.,) modified image value 84 
below To threshold 88 and an output level Bn = 0 at 98. The upward transition. 72 to 74, in input level In is 

20 thus encoded as a downward transition, 96 to 98 in the Bn output level. 

In an embodiment of the system according to the present invention, identification of l(n) and To as 
independent components of the algorithm allows the representation of the algorithm for encoding of a 
continuous tone digital image by the expression. 



=. >tri>| U\i r>(i» r KnJ.n | (2) 
1=1) 

30 

where B(n) represents the output of the modified error diffusion algorithm. The threshold term T is shown as 
a function of both l(n) and n, where n represents the respective pixel position in the input image scanline. 
This illustrates an additional degree of freedom that can be used to adapt the local pulse distribution to the 
digital image output requirements, such as controlling edge enhancement. Specific methods for the 
35 calculation of threshold T are indicated by the expressions. 



T{l(n),n} =:^Tf, -h 1KA2N { S: a,in)> (3a) 

40 i = n-N 



Tf f(n).n y = To (K-(J KnJ (3b) 

45 

where To is a constant such that O^To^t * aj is a weighting factor and N is an arbitrary nonnegative Integer. 
The enhancement factor K may be held constant or may vary as a function of the input image content, local 
or global, within the continuous tone input image. Choices for T{l(n),n} include, but are not limited to 
expressions 3a and 3b above. 

60 Wtth reference to FIG. 3, there is shown a general flow chart of an embodiment of the system according 

to the present invention, using the expressions 2 and 3b above. The image input blocl< 10 introduces the 
input digital image into the system on a pixel by pixel basis. Each input pixel has its corresponding error 
En-1 added to the input value at adder 12» prior to passing the sum to the modified image block 14. The 
modified image data, the sum of the input value and the error value of the previous input pixel (1„ + is 

ss passed to the threshold comparator block 20. 

The modified threshold level Tp is determined by first calculating a modifier based on the input value 
of each pixel, as represented in the threshold modifier block 40. The modifier value In(K-l) is then 
subtracted from the nominal threshold value To in the threshold calculation block 42. to detennnine the 

4 
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threshold value Tn to be applied at the threshold comparator block 20. Altemafively. it is possible to 
■ accomplish an equivalent aiteratlon of the threshold through the addition of the modifier value It,(K-1 ) to the 
modified image vaiue (!„ + En.,) while maintaining the threshold value at its nominai level To- 

The modified image value <ln + En^i) Is compared to the modified threshold level. Tn to determine the 

5 appropriate output level via blocks 22 and 24. Output level Is then subtracted from the modified 
image value (1^^ + En-i) to determine the error level for the subsequent input pixel. The subtraction 
operation is represented by the sign inversion block 26 and subsequent add block 28, with E^, at error 
block 30, representing the difference between the modified image value (In-f- En-i) and the output value Bn. 
The delay buffer block 32 represents a single pixel delay to store £„ in the simplified 1 -dimensional 

10 situation. 

An iltustration of the data associated with the processing of a scanltne is shown in FIG, 4. The input 
value In is shown in RG. 4a. with two typical transition steps 100 and 102. The corresponding modified 
image values {In + En.i) are illustrated in FIG. 4b for the progression of successive pixels, with the modified 
threshold level Tn sLiperimposed as a dashed line. The transition points 110 and 112 for the threshold Tn 
15 correspond with transitions 100 and 102 of U due to the fact that the threshold level Tn is now a function of 
lr> from expression 3b above. At any point that the modified image value En-i) exceeds the threshold 
level Tn, a binary pulse will be output as indicated by curve Bn in FIG. 4c. Specifically, in FIG. 4b the 
modified Image value (1^+ En-^) at 114 is below the threshold level Tn 116. resulting in an output level B^ at 
130 as illustrated in FIG. 4c. 

20 Processing of tho subsequent input image pixel Cn+ 1) provides a modified image value 118, as shown 
in FIG. 4b. The modified image value (1^*1+ E(n.i*i) 11B is compared to the threshold Tn*i, now at level 
120 due to the change in the input pixel level l^^^ at transition 100. The modified image value (In* i + E(n4). 
-.i) exceeds the threshold level T„^i resulting in an output level Br,-.i at 132. Subsequent pixels, for 
example pixel (n + 2) whose modified image value is indicated by 122. will be processed with the lower 

25 threshold level Tn^2 indicated by 120. until another image input transition 102 occurs causing the threshold 
transition 112. Through the modification of the threshold level Tn at input image transition points 100, 102, 
there is provided specific control of the amount of edge enhancement produced In this modified error 
diffusion technique. 

While the embodiment described herein Is limited to a 1 -dimensional representation for the sake of 

30 simplified explanation, it should be understood that this technique is designed and Intended for use in a 
multidimensional situation, where the display implementation represents a 2-dimensional situation and the 
display of time varying data represents a 3-dimersional situation. In addition, use of multiple threshold 
values T will allow generation of output for any multilevel output display, not being limited to the binary 
output as described. Furthermore, the threshold level T, while illustrated as a function of a single input pixel. 

35 can be implemented as a function of a plurality of Input pixels representing a region or neighborhood within 
the continuous tone input Image. 

The embodiment described herein can also be expanded to Include cornposite images, such as color 
images, where each color component might be treated individually by the algorithm, or where a vector 
quantization technique may be used to treat the image in a composite manner. In the case of color input 

40 images, edge enhancement could be used to control the color difference at a color transition while 
minfmizing any effects on the brightness at that location. Further expansion of this embodiment, in the area 
of computer generated hologramSt would enable control of the edge enhancement of an input image to 
modify the amount of light diffracted into the desired order. 

While there has been Illustrated and described what is at present considered to be a preferred 

45 embodiment of the present Invention, it will be appreciated that numerous changes and modifications are 
Hkely to occur to those skilled in the art, and it is intended in the appended claims to cover all those 
changes and modifications which fall within the scope of the present Invention, 



QO Claims 

1. A method of image encoding in a system for manipulating and displaying digital images represented by 
a plurality of pixels, each pixel having a given value, the system having a memory for digitelly storing the 
image pixels and a screen for displaying the image as a raster of pixels having a plurality of output states. 
56 the method including the steps of: 

comparing (20) the given value of a first pixel (1^) with a threshold (T^). 

determining (22, 24) the output state (B^) of said first pixel depending upon the relationship of the pixel to 
the output state. 
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introducing (12, 14) the variance (E„) of the first pixel value from the output state into the deviation of a 
second pixef value from the threshold to determine the output state of the second pixel, 
repeating the steps for each pixel of the digital image, and 

sefectively changing {40, 42) the threshold level (T^) during the image encoding, rncludirig analyzing the 
5 value of each pixel in order to determine if the tinreshold level should be changed, 

2, A method of image encoding in a system for displaying digital images represented by a plurality of 
pixels, each pixel having a given value, the system having a memory for digitally storing the image pixels 
and a screen for displaying the image as a raster of pixeJs having a first and a second encoded state, the 
method including comparing the values of each pixel in sequence with a threshold to determine the 

TO encoded states of said pixels, and also including the steps of: 

determining the variance of the values of each pixel from the encoded state of said pixels. 

introducing the variance of each pixel value from the encoded state into the variance of each successive 

pixel value, and 

comparing the variance of the value of each pixel, including the variance of its previous pixel, to the 
75 threshold level to determine the encoded state of tiie pixel, and 

selectively changing the threshold during the image encoding, the step of selectively changing the threshold 
level including the step of analyzing the values of pixels within a neighborhood of pixels to determine if the 
threshold should be changed, 

3. The method of claim 1 or claim 2 wherein the given values of the pixels are greyscale levels. 
20 4. The method of claim 1 or claim 2 wherein the given values of the pixels are color values. 

5. The method of claim 1 or claim 2 wherein the output states or encoded states are detenmined by 
comparison to a plurality of thresholds generating a plurality of output states. 

6. The method of claim 1 or claim 2 wherein the step of introducing the variance" includes the step of 
adding the variance of each pixel from the output state or the encoded state to the variance of each 

25 previous pixel from the output state or the encoded state of said prewous pixel. 

7. A method of edge enhancement of a digital image in a system for manipulating digital images, 
represented by a plurality of pixels having greyscale levels, to provide a first and a second pixel state, the 
method including the steps of: 

comparing the greyscale level of a first pixel to a threshold level To to determine a first or second state for 
30 said first pixel, 

analyzing the greyscale level of a second pixel, 

responding to the analysis of the greyscale level of the second pixel to change the threshold level to Ti. 
and 

comparing the greyscale level of the second pixel to the threshold level Ti to determine a first or second 
as state for said second pixel. 

8. A method of image edge enhancement in a system for manipulating and displaying digital greyscale 
im'ages represented by:a plurality of pixels, the system'having a memory for digitally storing the greyscale 
image pixels and a screen for displaying the image as a raster of pixels having either a 0 or a 1 output 
state, the method including the steps of: 

40 determining the 0 or 1 state of a first pixel depending upon the relationship of the pixel greyscale level to 
the threshold level, 

comparing the greyscale level of said first pixel with reference to the 0 or 1 output state to determine the 
variance of the greyscale level from the output state, and 

introducing the variance of the first pixel greyscale level from the output state into the deviation of a second 
45 pixel greyscale level from the threshold level to determine the 0 or 1 state of the second greyscale pixel, 
wherein th© improvement comprises the step of analyzing the greyscale level of each pixel in order to 
determine if the threshold level should be changed. 

9. A technique for manipulating a digital image represented by a plurality of pixels, each of the pixels 
tiaving an associated greyscale level, to provide edge enhancement of the image to be displayed as a 

so raster of said pixels, each pixel of the raster represented by a 0 or 1 output state, including th© steps of: 
comparing the greyscale level of a first pixel with a reference greyscale threshold level, 
determining the 0 or 1 output state of said first pixel depending upon the relationship of the pixel greyscale 
level to the threshold level, 

calculating the variance of the first pixel greyscale level from the output state, 
55 comparing the greyscale level of a second pixel with the reference greyscale threshold level, 

determining the 0 or 1 state of said second pixel depending upon the relationship of the pixel greyscale 
level of the second pixel to the threshold level and depending upon the variance of tho first pixel greyscale 
level from the output state, and selectively adjusting the threshold level for selected pixels in response to 

6 
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the greyscale ievel of said selected pixels. 

10. A technique tor mahipufating a digital image represented by a plurality of pixels, each of the pixels 

having an associated greyscale level, to provide edge enhancement of the image to be displayed as a 
raster of said pixels, each pixel of the raster being represented by a 0 or 1 encoded state, including the 
5 steps of: 

comparing the greyscale level of a first pixel with a reference greyscale threshold level, 

determining the 0 or 1 encoded state of said first pixel depending upon the relationship of the pixel 

greyscale level to the threshold level, 

calculating the variance of the first pixel greyscale level from the encoded state. 
10 comparing the greysca!e level of a second pixel with the reference greyscale threshold level. 

determining the 0 or 1 encoded state of said second pixel depending upon the relationship of the pixel 
greyscale level of the second pixel to the threshold level and depending upon the variance of the first pixel 
greyscale level from the encode state, and 

selectively adjusting the threshold level for selected pixels in response to the greyscale level of said 
76 selected pixels. 
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